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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

• Extensions of time may be available under the provisions of 37 CFR 1.136<a). In no event, however, may a reply be timefy filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply vwthin the statutory minimum of thirty pO) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)S Responsive to communication(s) filed on 21 May 2003 . 
2a)[3 This action is FINAL. 2b)n This action is non-final. 

3) n Since this application is in condition for allowance except for fonmal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
Disposition of Claims 

4) S Claim(s) 7-27 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) S Claim(s) 1-27 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10) S The drawing(s) filed on 21 I\/Iav2003 is/are: a)I3 accepted or b)^ objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a}. 

11) D The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) 0 The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

13) n Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (0. 

a)nAII b)n Some*c)n None of: 

1 .□ Certified copies of the priority documents have been received. 

2.n Certified copies of the priority documents have been received in Application No. . 



3.n Copies of the certified copies of the priority documents have been received In this National Stage 
application from the Intemational Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) n Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) n Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121 . 
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Claim Rejections - 35 USC§112 
The following is a quotation of the first paragraph of 35 U.S.C. 1 12: 

The specification shall contain a written description of the invention, and of the manner and process of making 
and using it, in such ftill, clear, concise, and exact terms as to enable any person skilled in the art to which it 
pertains, or with which it is most nearly connected, to make and use the same and shall set forth the best mode 
contemplated by the inventor of carr>'ing out his invention. 

1. Claims 1, 23 are rejected under 35 U.S.C. 112, first paragraph, as failing to comply with 
the written description requirement. The claim(s) contains subject matter which was not 
described in the specification in such a way as to reasonably convey to one skilled in the relevant 
art that the inventor(s), at the time the application was filed, had possession of the claimed 
invention. The newly introduced limitation: "the movable hand-held device being capable of 
sending control signals to a remotely controllable device" has subject matter which was not 
described in the specification in such a way as to reasonably convey to one skilled in the relevant 
art that the inventor(s), at the time the application was filed, had possession of the claimed 
invention. The specification only describes only detected position of the device is translated to 
corresponding coordinates on a display, which could be used to locate a cursor corresponding to 
the movement of the hand-held device in the user's hand. 

Claim Rejections - 35 VSC § 102 
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 1 22(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent bv another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 351(a) shall have the elTects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 
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(b) the invention w'as patented or described in a printed publication in this or a foreign countrv' or in public use or on 
sale in this country', more than one year prior to the date of application for patent in the United States. 

2. Claims 1-9 are rejected under 35 U.S.C. 102(e) as being anticipated by Lin (US Patent 
No. 6,346,933 Bl). 

As to claim 1, as best understood by examiner, Lin teaches a system with: at least one 
light source in a movable hand-held device, the movable hand-held device being capable of 
sending control signals to a remotely controllable device (See Fig. 1, items 1 1,30, in description 
see Col. 3, hnes 25-45); at least on light detector that detects light from light source (See Fig. 
1, item 3 1, in description see Col. 3, lines 32-35); a control unit that receives image data from at 
least one light detector (See Fig. 1, item 30, in description see Col. 3, lines 32-45); wherein the 
control unit detects position of the hand-held device in at least two-dimensions from the image 
data fi'om the at least one light detector and translates the position to control a feature on a 
display (See Fig. 1, items 1 1, 30,31,37 in description see Col. 3, lines 46-54). 

As to claim 2, Lin teaches at least one light detector is a digital camera (See Fig. I, item 
30, in description see Col. 3, lines 32-45). 

As to claim 3, Lin teaches digital camera captures a sequence of digital images that 
include the light emitted by the hand-held device transmitted to the control unit (See Fig. 1, items 
30-31, 63a-63n, in description See Col. 4, Lines 17-33). 
(See Fig. 1, items 30-31, 63a-63n, in description See Col. 4, Lines 17-33). 

As to claim 4, Lin teaches the control unit comprises an image detection algorithm that 
detects the image of the light of the hand-held device in the sequence of images transmitted from 
the digital camera (See Fig. 1, items 16, 33,35, 63a-63n, in description See Col. 4, Lines 33-54). 
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As to claim 5, Lin teaches the control unit maps a position of the detected hand-held 
device in the images to a display space for the display (See Fig. 1, items 13,16, 37, in description 
See Col. 6, Lines 6-20). 

As to claim 6, Lin teaches the mapped position in the display space controls the 
movement of a feature in the display space (See Fig. 1, items 13,16, 37, in description See Col. 
6, Lines 21-45). 

As to claim 7, Lin teaches the feature in the display space is a cursor (See Col. 1 , Lines 

27-46). 

As to claims 8-9, Lin teaches the captured images processed by the control unit for the 
purpose of teleconferencing (presentation), image transmission, and image recognition (See Col. 

2, lines 30-34). 

3. Claim 23 is rejected under 35 U.S.C. 102(b) as best understand by examiner, as being 
anticipated by Rice et al. (US Patent 5,973,672). 

Rice at al. teaches a system comprising two or more movable hand-held devices, each 
hand-held device with at least one light source at least one of the two or more movable hand-held 
device being capable of sending control signals to a remotely controllable device (See Fig. 1, 
items 15,25, in description See from Col. 1, Line 61 to Col. 2, Line 54), at least one light 
detector deteaing light from the at least one light source of each of the two or more hand-held 
devices (See Fig. 1, item 18, in description See Col. 1, Line 61 to Col. 2, Line 26), a control unit 
that receives image data from the at least one light detector (See Fig. 1, items 19-23, in 
description See Col. 1, Line 61 to Col. 2, Line 26), wherein the control unit detects the positions 
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for each of the two or more movable hand-held devices in at least two dimensions from the 
image data from the at least one light detector and translates the positions for each of the two or 
more movable hand-held devices to separately control two or more respective features on a 
display (See Fig. 1, items 19-23, in description See Col. 1, Line 61 to Col. 2, Line 26). 

Claim Rejections - 35 USC §103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or descnbed as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art arc 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability' shall not be negatived by the 
maimer in which the invention was made. 

4. Claim 10 rejected under 35 U.S.C. 103(a) as being unpatentable over Lin as 
aforementioned in claim 1 in view of Kim. et al. (US Patent No. 6,424,335 Bl). 

Lin does not show at least one light source is an LED. 

Kim et al. teaches LED as light source See Fig. 1, item 100, in description See Col. 8, 
Lines 44-58). It would have been obvious to one of ordinary skill in the art at the time of 
invention to use LED as light source as shown by Kim et al. in the Lin apparatus in order to 
achieve wireless input device which is energy efficient, consistent with operating the input 
device an extended distance from the computer (See Coll. 3, Line 66 to Col. 4, Line 2 in the Kim 
et al reference). 

5. Claims 11-16 rejected under 35 U.S.C. 103(a) as being unpatentable over Lin, and Kim et 
al. as aforementioned in claim 1 in view of Fitts (US Patent No. 5,175,601). 
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As to claims 11-12, Lin does not show two digital cameras each capture a sequence of 
digital images that include the light emitted by the hand-held device, transmitted by each camera 
to the control unit. 

Fitts teaches two cameras with digitizers and processing of digitized images (See Fig. 1, 
items 2-3, 13,15, in description See Col. 7, Lines 45-68). It would have been obvious to one of 
ordinary skill in the art at the time of invention to use two cameras as shown by Fitts in the Lin 
apparatus to allow two digital cameras each capture a sequence of digital images that include the 
light emitted by the hand-held device, transmitted by each camera to the control unit in order to 
permit on line interaction (See Coll. 6, Line 45-46 in the Fitts reference). 

As to claim 13, Lin teaches an image detection algorithm that detects the image of the 
light of the hand-held device in each sequence of images transmitted from digital camera (See 
Fig. 1, items 16, 33,35, 63a-63n, in description See Col. 4, Lines 33-54). 

Lin does not show two digital cameras. 

Fitts teaches two cameras with digitizers and processing of digitized images (See Fig. 1 , 
items 2-3, 13,15, in description See Col. 7, Lines 45-68). It would have been obvious to one of 
ordinary skill in the art at the time of invention to use two cameras as shown by Fitts in the Lin 
apparatus to develop an image detection algorithm that detects the image of the light of the hand- 
held device in each sequence of images transmitted from two digital cameras in order to permit 
on line interaction (See Coll. 6, Line 45-46 in the Fitts reference). 

As to claim 14, Lin does not show the control unit with depth detection algorithm that 
uses the position of the light in the images received from each of the two cameras to determine a 
depth parameter from a change in a depth position of the hand-held device. 
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Fitts teaches two cameras with digitizers and processing of digitized images (See Fig. 1, 
items 2-3, 13,15, in description See Col. 7, Lines 45-68). It would have been obvious to one of 
ordinary skill in the art at the time of invention to use two cameras as shown by Fitts in the Lin 
apparatus to develop depth detection algorithm that uses the position of the light in the images 
received from each of the two cameras to determine a depth parameter from a change in a depth 
position of the hand-held device cameras in order to permit on line interaction (See Coll. 6, Line 
45-46 in the Fitts reference). 

As to claims 15-16, Lin does not show the control unit maps a position of detected hand- 
held device in at least one of the images from one of the cameras and depth parameter to a 3D 
rendering in a display space and mapped position controls the movement of a feature in 3D 
rendering in the display space. 

Fitts teaches to use identifiable points on 3-D surface and measuring X-Y-Z 
coordinates of these points based on knowledge of how two cameras are referenced to each other 
(See Fig. 1, items 2-3, 12, in description See Col. 3, Lines 33-54). It would have been obvious to 
one of ordinary skill in the art at the time of invention to use two cameras as shown by Fitts in 
the Lin apparatus to map a position of detected hand-held device in at least one of the images 
from one of the cameras and depth parameter to a 3D rendering in a display space and mapped 
position controls the movement of a feature in 3D rendering in the display space in order to 
permit on line interaction (See Coll. 6, Line 45-46 in the Fitts reference). 

6. Claims 17-21 rejected under 35 U.S.C. 103(a) as being unpatentable over Lin as 
aforementioned in claim 1 in view of Arita et al. (US Patent No. 6,188,388 Bl). 
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As to claims 17-18, Lin does not show two light sources in one hand-held unit and the 
digital camera captures a sequence of digital images that includes the light from the two light 
sources of the hand-held, the sequence of images transmitted to the control unit. 

Arita et al. teaches two light sources in one hand-held unit (See Fig. 1,9-10, items Pb, 
Kh, Ki, in description See Col. 12, Lines 1 1-25). It would have been obvious to one of ordinary 
skill in the art at the time of invention to use two light sources as shown by Arita et al. in the Lin 
apparatus to allow the digital camera captures a sequence of digital images that includes the light 
from the two light sources of the hand-held, the sequence of images transmitted to the control 
unit in order to improve precision (See Coll. 4, Line 5-8 in the Arita et al. reference). 

As to claim 19, Lin show the control unit has an image detection algorithm (in abstract 
Lin identifies gesture spatial pattern which obviously if not inherently includes detection 
algorithm) Lin does not show detecting the image of the two light sources in the sequence of 
images transmitted from the digital camera. 

Arita et al. teaches two light sources in one hand-held unit (See Fig. 1,9-10, items Pb, 
Kh, Ki, in description See Col. 12, Lines 1 1-25). It would have been obvious to one of ordinary 
skill in the art at the time of invention to use two light sources as shown by Arita et al. in the Lin 
apparatus to allow an image detection algorithm that detects the image of the two light sources in 
the sequence of images transmitted from the digital camera in order to improve precision (See 
Coll. 4, Line 5-8 in the Arita et al. reference). 

As to claims 20-21, Lin does not show and detected angular aspect of the hand-held 
device from the images of the two light sources does not maps angular aspect to a display space. 
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Arita et al. teaches two light sources in one hand-held unit (See Fig. 1,9-10, items Pb, 
Kh, Ki, in description See Col. 12, Lines 1 1-25). It would have been obvious to one of ordinary 
skill in the art at the time of invention to use two light sources as shown by Arita et al. in the Lin 
apparatus to allow show and detected angular aspect of the hand-held device from the images of 
the two light sources does not maps angular aspect to a display space in order to improve 
precision (See Coll. 4, Line 5-8 in the Arita et al. reference). 

7. Claim 22 rejected under 35 U.S.C. 103(a) as being unpatentable over Lin and Arita et al. 
as aforementioned in claim 22 in view of Fitts. 

Lin and Arita et al. do not show light source emits visible light. 

Fitts teaches visible light as light source (See Fig. 1, item 8, in description See Col. 8, 
Lines 33-35). It would have been obvious to one of ordinary skill in the art at the time of 
invention to use visible light source as shown by Fitts in the Lin and Arita et al. apparatus. 

8. Claims 24-26 rejected under 35 U.S.C. 103(a) as being unpatentable over Rice et al. as 
aforementioned in claim 23 in view Kim et al. 

Rice et al. does not show the at least one light source of the two or more hand-held 
devices each turn on and off at a flashing frequency and emit light at a flashing wavelength with 
different frequencies. 

Kim et al. teaches digital pulse format suitable for infrared transmission and detection as 
well known (see Fig. 2C, item 180, in description See Col. 8, Lines 44-58). It would have been 
obvious to one of ordinary skill in the art at the time of invention to use pulsing sources as shown 
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by Kim et al. in the Rice et al. apparatus at a flashing wavelength with different frequencies in 
order to allow input device is energy efficient (See Coll 3, Line 66-67 in the Kim et al. 
reference). 

9. Claim 27 rejected under 35 U.S.C. 103(a) as being unpatentable over Rice et al. and Kim 
et al. as aforementioned in claim 26 in view of Fitts. 

Rice et al. and Kim et al. do not show light source emits visible light. 

Fitts teaches visible light as light source (See Fig. 1, item 8, in description See Col. 8, 
Lines 33-35). It would have been obvious to one of ordinary skill in the art at the time of 
invention to use visible light source as shown by Fitts in the Rice et al. and Kim et al. apparatus. 

Response to Amendment 

10. Applicant's arguments filed on 05-21-03 have been fully considered but they are not 
persuasive. 

On pages 5-6, in relation to the independent claims 1 and 23, The Applicant stated that 
Lin and Rice references using "conventional" light pointers instead of commercially available 
hand-held device. However, these "conventional" light sources are satisfied all limitations of 
independent claims 1 and 23, including newly added: 'the movable hand-held device capable of 
sending control signals to a remotely controllable device' (See Abstract and Col. 3, Lines 52-54 
in Lin reference and Col. 2, Lines 29-34 in Rice et al. reference). 

On page 6, third paragraph, in relation to claim 10, Applicant stated that it would not be 
obvious to use a remote control (not in claims, in claims only light source is mentioned) as 
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appointing device on a display. However, Rice et al. uses pointing device on a projection display 
(See Col. 2, Lines 29-34). In response to applicant's argument that there is no suggestion to 
combine the references, the examiner recognizes that obviousness can only be established by 
combining or modifying the teachings of the prior art to produce the claimed invention where 
there is some teaching, suggestion, or motivation to do so found either in the references 
themselves or in the knowledge generally available to one of ordinary skill in the art. See In re 
Fine. 837F.2d 1071, 5 USPQ2d 1596 (Fed. Cir. 1988) and /w re ./owe.v, 958 F.2d 347, 21 
USPQ2d 1941 (Fed. Cir. 1992). 

Conclusion 

1 1 . Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 . 136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 
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Telephone inquire 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Leonid Shapiro whose telephone number is 703-305-5661 . The 
examiner can normally be reached on 8 a.m. to 5 p.m.. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Bipin Shalwala can be reached on 703-305-4938. The fax phone numbers for the 
organization where this application or proceeding is assigned are 703-872-93 14 for regular 
communications and 703-872-9314 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is 703-305-4750. 



Is 

June 13,2003 
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